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Motivation 


in what ways quantum computers are 
more efficient than classical computers? 

what problems could be solved more 
efficiently on a quantum computer? 

□ best-known examples are: 

■ Shor's algorithm for integer factorization, solves the problem in 
polynomial time (exponential speedup). 

current quantum computers can factor all integers up to 21. 

■ Grover's algorithm is a quantum algorithm for searching an unsorted 
database with N entries in o(JV 1/2 ) time (quadratic speedup). 

□ importance is huge (cryptanalysis, etc.). 
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Motivation 

what more can quantum computers do? 

□ here, we will discuss "hard" satisfiability (SAT) and 
optimization problems which are at least "NP-complete" i.e., 

■ hard to solve classically; time needed is exponential in the 
input (exponential complexity). 

■ could a quantum computer solve these problems in an 
efficient manner? perhaps even in polynomial time? 

□ we also discuss the graph isomorphism problem. 

the Quantum Adiabatic Algorithm 
is a general approach to solve a broad range of 
hard optimization problems using a quantum 
computer [Farhi et al.,2001] 
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Outline 

□ introduction: 

■ the quantum adiabatic algorithm (QAA) 

□ satisfiability problems 

■ the specific SAT models studied 

■ method: quantum Monte Carlo simulations 

■ results: complexity of the quantum adiabatic 

algorithm 

■ results: comparison to the classical algorithm 

Walks AT 

□ 3reg Max-Cut: an antiferromagnet on a random graph 

□ QAA, applied to the graph isomorphism problem 

□ summary, conclusions and future research 
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■ The Quantum 

Adiabatic Algorithm (QAA) 
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The adiabatic theorem of QM 


□ the adiabatic theorem of QM tells us that a physical system 
remains in its instantaneous eigenstate if a given perturbation 
is acting on it slowly enough and if there is a gap between 
the eigenvalue and the rest of the Hamiltonian's spectrum. 
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The adiabatic theorem of QM 


□ the adiabatic theorem of QM tells us that a physical system 
remains in its instantaneous eigenstate if a given perturbation 
is acting on it slowly enough and if there is a gap between 
the eigenvalue and the rest of the Hamiltonian's spectrum. 


□ example: change the strength of a harmonic potential of a 
system in the ground state: 
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The adiabatic theorem of QM 


□ the adiabatic theorem of QM tells us that a physical system 
remains in its instantaneous eigenstate if a given perturbation 
is acting on it slowly enough and if there is a gap between 
the eigenvalue and the rest of the Hamiltonian's spectrum. 


□ example: change the strength of a harmonic potential of a 
system in the ground state: 

□ an abrupt change 
(a diabatic process): 
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The adiabatic theorem of QM 


□ the adiabatic theorem of QM tells us that a physical system 
remains in its instantaneous eigenstate if a given perturbation 
is acting on it slowly enough and if there is a gap between 
the eigenvalue and the rest of the Hamiltonian's spectrum. 


□ example: change the strength of a harmonic potential of a 
system in the ground state: 


□ a gradual slow change 
(an adiabatic process) : 
wave function can "keep up 
with the change. 
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The quantum adiabatic algorithm (QAA) 


□ the mechanism proposed by Farhi et al., the QAA: 



/ \ 

1. take a difficult (classical) optimization problem. 

[2. encode its solution in the ground state of a quantum 
[ "problem" Hamiltonian Hp. 

f 3. prepare the system in the ground state of another 
[ easily solvable "driver" Hamiltonian" H d .[H p ,H d ] =£ 0. 

\A. vary the Hamiltonian slowly and smoothly from 
I H d to H p until ground state of H p is reached. 
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The quantum adiabatic algorithm (QAA) 


□ the interpolating Hamiltonian is this: 


H(t) = s(t)H„ + [1 - s(t)]H d 



H v is the problem Hamiltonian whose 


ground state encodes the solution of 
the optimization problem 


H d is an easily solvable 
driver Hamiltonian, which 
does not commute with H 


v 


□ the parameter s obeys 0 < s(t) < 1 , with s(0) = 0 and 
s(T) = 1. also: H( 0) = H d and H(T ) = H p . 

□ here, t stands for time and T s the running time, or 
complexity, of the algorithm. 
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The quantum adiabatic algorithm (QAA) 

□ the interpolating Hamiltonian is this: 

f A 

H(t) = s(t)H p + [1 - s(t)]H d 

V ) 

□ the adiabatic theorem ensures that if the change in s(t) is 
made slowly enough, the system will stay close to the 
ground state of the instantaneous Hamiltonian throughout 
the evolution. 

□ one finally obtains a state close to the ground state of H p . 

□ measuring the state will give the solution of the original 
problem with high probability. 

how fast can the process be? 
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Quantum phase transition 


□ bottleneck is likely to be a quantum phase transition (QPT) 
where the gap to the first excited state is small. 


□ there, the probability to "get off track" is maximal. 
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Quantum phase transition 


□ Landau-Zener theory tells us that to stay in the ground 
state the running time needed is: 



□ exponentially closing gap (as a function of problem size N) 
exponentially long running time exponential complexity. 
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Quantum phase transition 


□ Landau-Zener theory tells us that to stay in the ground 
state the running time needed is: 


r* 1 / 


A E 


rrun 


□ exponentially closing gap (as a function of problem size N) 
exponentially long running time exponential complexity. 


□ it would be interesting to explore what one can do with "Local 
Adiabatic Evolution", i.e., by slowing down when approaching 
the minimum gap etc. for example, the adiabatic 
algorithm for Grover's search problem. 
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The quantum adiabatic algorithm 


□ most interesting unknown about QAA to date: 

could the QAA solve in polynomial time 
"hard" (NP-complete) problems? 

or 

for which hard problems is T sub-exp' in N ? 
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The quantum adiabatic algorithm 


□ most interesting unknown about QAA to date: 

could the QAA solve in polynomial time 
"hard" (NP-complete) problems? 

or 

for which hard problems is T sub-exp' in N ? 

□ early studies on very small systems 

(number of bits N < 24) seemed to indicate that for some 
problems complexity scales like N 2 . 

□ later studies on bigger systems showed a "crossover" from 
polynomial to exponential complexity 

□ matter is still in debate [Altshuler et al., Knysh and 

. no clear-cut example. Sergey's latest result. 
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The quantum adiabatic algorithm 


□ another interesting unknown: 

what is the future of 
adiabatic quantum computation? 

□ almost no examples that adiabatic quantum computation Is 
efficient, however there exists an adiabatic version of Grover's 
search algorithm that uses "local adiabatic evolution". 

□ also, there is a correspondence between circuit-based 
computing and adiabatic computing [Aharonov et al., 200J . 

□ also, D-Wave Systems have built operational prototypical 
quantum annealers based on superconductor flux qubits (still 
being debated whether really quantum or not). 
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^^^Satisfiability problems 
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Satisfiability problems 

□ here, we consider certain "constraint satisfaction" (SAT) 
problems that are known to be hard classically. 

□ in SAT problems we ask whether there is an assignment of 
N bits (or Ising spins) which satisfies all of M clauses (or 
logical conditions), bits in each clause are chosen at random. 
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Satisfiability problems 

□ here, we consider certain "constraint satisfaction" (SAT) 
problems that are known to be hard classically. 

□ in SAT problems we ask whether there is an assignment of 
N bits (or Ising spins) which satisfies all of M clauses (or 
logical conditions), bits in each clause are chosen at random. 


N bits 
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Satisfiability problems 

□ here, we consider certain "constraint satisfaction" (SAT) 
problems that are known to be hard classically. 

□ in SAT problems we ask whether there is an assignment of 
N bits (or Ising spins) which satisfies all of M clauses (or 
logical conditions), bits in each clause are chosen at random. 

□ an example for a clause containing the bits x 1 ,x 2 ,x 3 would 
be: (x^ a —ix 2 a — 1X3) v ( x 2 a — 1X3 a — ix^) v (X3 a — ix-l a —1X2). 
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Satisfiability problems 

□ here, we consider certain "constraint satisfaction" (SAT) 
problems that are known to be hard classically. 

□ in SAT problems we ask whether there is an assignment of 
N bits (or Ising spins) which satisfies all of M clauses (or 
logical conditions), bits in each clause are chosen at random. 

□ an example for a clause containing the bits x 1 ,x 2 ,x 3 would 
be: (x^ a —ix 2 a — 1X3) v ( x 2 a — 1X3 a — ix^) v (X3 a — ix-l a —1X2). 



a "satisfying 
assignment" 
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Satisfiability problems 

□ for small M/N\ easy to satisfy all clauses, exponential 
number of solutions or "satisfying assignments" (SAT phase). 

□ for large M/N\ no satisfying solution exists (UNSAT phase). 

□ we take the ratio of M/N to be at the satisfiability threshold, 
where it is difficult to find a solution. 


□ we study random instances with a unique satisfying 
assignment ( U SA) . numerically more convenient because 
model is gapped. 

_a "satisfying 
— assignment" 
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Satisfiability problems 


□ the SAT problems we examined: 

■ locked l-in-3: a clause is a triplet of bits picked at 
random from a pool of N bits, it is satisfied if and only if 
exactly one bit s 1 and the other two are 0. 

■ locked 2-in-4: same as above only with 2 bits out of 4 in 
each clause that must be 1 [Zdeborova & Mezard, 08]. 

■ 3-regular 3-xorsat 3org et af : \ \ /' 

here, each bit is exactly in tiT Xxi xX 

3 clauses and a clause is JT) x 

satisfied if the sum of the V 

3 bits in a clause (mod 2) is a 

value specified (0 or 1). r< / 

this problem is in P. / \ factor 9 raph 

\ of 3-regular 3-xorsat 
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The encoding Hamiltonians 


□ the SAT problems are encoded in problem Hamiltonians that 
are sums of clause Hamiltonians, each of the clauses is a sum 
of products of of matrices. 


H 


p 


= Y » a (an 


a=l..M 


□ the ground state of the problem Hamiltonian H p is a solution 
to the SAT problem. H p is diagonal in the computational basis. 


□ we choose the simplest possible driver Hamiltonian (e.g., 
equal weights): 


H 


d 




□ this is a simple transverse-field Hamiltonian, it does not 
commute with any of the problem Hamiltonians, its ground 
state is unique and its energy is 0. the gap is 1. 
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Method 

□ main goal: 

determine the complexity of the 
QAA for the various SAT problems 

□ study the dependence of the typical minimum gap 

/ \ 

A£min = min A E 

{ se(o,i) J 

on the size N (number of bits) of the problem. 

□ this is because: 



□ polynomial dependence -> polynomial complexity! 
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Method 


□ for each given problem we study several system sizes, 
because we are interested in size-dependence. 

□ we consider typically 50 instances per problem size, 
to obtain "typical behavior" we take medians. 

□ for each instance, we measure the gap of the system for 
several values of the parameter s in order to obtain an 
accurate estimation of the minimum gap. 

□ for each s value, we run a quantum Monte Carlo (QMC) 
simulation to obtain the gap numerically (and other 
measureable quantities). 


Itay Hen 


AQC 2013 


March 6-8, 2013 


Quantum Monte Carlo 


□ for large system sizes, we can not use exact diagonalization. 

□ we employ a continuous-time quantum Monte Carlo (QMC) 
technique. 

□ an additional periodic dimension of imaginary time 0 < r < /?. 
/? is the inverse-temperature obeying /?A E 1 » 1. 

□ with QMC we do a sampling of the 2 N states of the Hilbert 
space, exact-numerical up to statistical errors. 

□ QMC enables access to the equilibrium properties of the 
system but also provides indirect access to the system gap. 

□ here, we basically simulate spin-1/2 systems with different 
interactions and different sizes. 

□ we employ parallel tempering (swapping configurations of 
adjacent s values) which speeds up equilibration. 


Itay Hen 


AQC 2013 


March 6-8, 2013 


Quantum Monte Carlo: SSE 


□ we use the stochastic series 
expansion (SSE) algorithm 
devised by Anders Sandvik 

[Sandvik, 1991,1992,1994]. 

□ algorithm is based on a Taylor series 
expansion of the partition function 

Z = Tr[e~P n \ no systematic errors. 

□ algorithm enables both local and 
global (cluster or loop) updates 
which in most cases prove to be 
more efficient than single-spin-flip 
(local) updates. 


a typical segment of 
an SSE configuration 
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Extracting the gap 


□ we extract the gap of the system by measuring and 
analyzing different-imaginary-time correlation functions of 
certain operators: 

c a (t)=(A(t)A(0)) - (A) 2 
\ . ) 

□ if /?A E x » 1 (system is in its ground state) then at long 
imaginary times we have: 

C A ( T) s |(0|i|l)|V aE i r 

\ J 


□ i.e., only the slowest-decaying exponent survives (provided 
that the corresponding matrix element does not vanish). 
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Extracting the gap 


□ if conditions are right, then it is possible we extract the 
gap of the system. 

□ we use a straight line fit on a log-1 near scale. 

□ however, data becomes very noisy at large imaginary times. 


correlation function of a 
64-spin instance of the 
locked-l-in-3 problem 
(s = 0.39,/? = 1024). 
log-linear scale. 
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QMC results 


□ main goal: to determine the complexity of the QAA for the 
various SAT problems. 

□ for each of the problems studied, we look at the dependence 
of the typical (median) minimum gap on the size of the 
problem. 

□ a polynomial^ decreasing gap would mean a polynomial^ 
increasing running time and hence QAA could be called 
efficient. 

□ an exponentially decreasing gap would mean that the QAA is 
not more efficient than the best classical algorithm. 

□ heavy QMC simulations, hundreds/thousands of cores, 
running in some cases for weeks/months. 
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Locked l-in-3 SAT 


plots of the median minimum gap vs problem size N 




exponential (log-linear) fit power-law (log-log) fit 

clearly, the behavior of the minimum gap is exponential. 
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Locked 2-in-4 SAT 


plots of the median minimum gap vs problem size N 
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exponential (log-linear) fit power-law (log-log) fit 


clearly, the behavior of the minimum gap is exponential. 
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3-regular 3-XORSAT 

exponential (i.e., log-linear) plot of the median minimum gap 

3-reg XORSAT 



median minimum gap is exponential, 
even from small N, and even though problem is in P. 
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Comparison with a classical algorithm 

□ WalkSAT is a classical, heuristic, local search algorithm. 

□ it is a reasonable classical algorithm to compare with QAA 

[Guidetti and Young, 2010^ . 

□ the algorithm itself is very simple: 

■ pick at random an unsatisfied clause and flip a bit in 
that clause. 

■ with some probability this bit is chosen to be the one 
which causes the fewest previously satisfied clauses to 
become unsatisfied, and otherwise it is chosen at 
random. 

■ repeat until the number of unsatisfied clauses is zero. 
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Comparison with a classical algorithm 

□ WalkSAT is a classical, heuristic, local search algorithm. 

□ it is a reasonable classical algorithm to compare with QAA 

[Guidetti and Young, 2010 . 

□ the complexity of WalkSAT is determined by the amount of 
"bit flips" the algorithm performs until it reaches a solution. 

/ \ 

T « Nfijps- exp [nN] 

\ J 

□ for the QAA, we have 

/ \ 

T oc exp [2 cN] for oc exp[— cN] 
J 


□ we can therefore compare exponent coefficients. 
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Comparison with a classical algorithm 


□ running times are proportional to exp [uiV] where N is 
system size. 

a comparison of 
the ju values 
among the 
different models 
and between 
QAA and 
Walks AT 


Locked 1 -in-3 Locked 2— in— 4 3reg-3XORSAT 

□ WalkSAT is better, however we see the same trend. 

□ important to remember: we used here the simplest 
implementation of the QAA for instances with USA. 
algorithm can certainly be improved. 
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■ 3-regular random antiferromagnet 

(3-reg Max-Cut) 


Itay Hen 


AQC 2013 


March 6-8, 2013 


3-regular Max-Cut 


□ we have also studied one "MAX" (i.e., optimization) problem. 

□ MAX means that we are in the UNSAT phase, and would like 
to find the configuration with the least number of unsatisfied 
clauses. 

□ 3-regular: each bit is in exactly 3 clauses. 

□ Max-Cut: sum of two bits (product of two spins) must be a 
specified value. 

N bits 


M = 3N/2 clauses 

factor graph of the 3-regular Max-Cut 
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3-regular Max-Cut 

□ in our case, the Hamiltonian of a clause is: 



□ product of spins in a clause must be -1 to satisfy the clause. 

□ this is a 3-regular antiferromagnet on a random graph, note 
the symmetry under bit flips. 

□ however, solution is not a simple "up-down" antiferromagnet 
because of loops of odd length, in fact, this is a spin-glass. 

□ after adding a Driver Hamiltonian, there is a quantum phase 
transition above which symmetry is spontaneously broken. 

□ "Cavity" calculations (Gosset/Zamponi) find the transition at 
s * 0.36. 
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3-regular Max-Cut 


□ we observe minima near the expected phase transition 
(where the critical point was determined precisely) 

□ there are however additional avoided crossings inside the 
spin-glass phase as well 


phase 

transition 

minimum 



pj * 0.20 
<1 


gap to the first excited 
state as a function of the 
adiabatic parameter 5 
for one of the instances, 
showing two gap 
minima, here, N = 128 
and fl = 2048. 


additional 
minimum 
inside the spin- 
glass phase 



0.50 
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3-regular Max-Cut 


median minimum gap in the vicinity of the quantum transition 


3-reg MAX-2-XO RSAT 



N 


exponential (log-linear) fit 




3-reg M AX-2 -XO RSAT (near 0.36) 
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gap is polynomial near the phase transition, however 
additional avoided level crossings lead to an exponential gap 
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graph isomorphism problem 
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The graph isomorphism problem 


□ are two graphs the same upon 
permuting the indices? 

□ how could one use adiabatic 
quantum computation to answer 
this question? 

□ conjecture: all non-isomorphic 
graphs can be distinguished by putting a suitable Hamiltonian 
on the edges of a graph: 

■ we construct a problem Hamiltonian for each graph. 

■ we run the QAA a multiple number of times. 

■ we compute appropriate average physically measurable 
quantities by repeated measurements. 
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The graph isomorphism problem 


□ if the Hamiltonian and the 
quantities we choose are 
invariant under permutation of 
the indices, isomorphic graphs 
will give the same results. 

□ we hypothesize that 
non-isomorphic graphs can always be distnguished. 

□ we have tested the hypothesis for some small graphs 

(JV < 29) from various families of graphs that are known to 
be hard to distinguish (same adjacency matrices). 

□ so far, method seems to work if measurements are accurate 
enough. 



Itay Hen 


AQC 2013 


March 6-8, 2013 


The graph isomorphism problem 


□ we tried the "spin-glass" antiferromagnet on the graph: 


□ main results are for Strongly Regular Graphs (SRG's; families 
of similar but non-isomorphic graphs) but not just, we 
considered sizes from N = 15 to 29 vertices. 

□ we computed energy, x-magnetization ( M x ) and the spin 
glass order parameter ( Q 2 ) for different values of the 
adiabatic parameter s: 


Hp(G)=T. iiJ)€G 
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The graph isomorphism problem 


□ the value of Q 2 , the spin-glass 
order parameter, in the ground 
state for the two non-isomorphic 
SRG's on N = 16 vertices, as a 
function of the adiabatic 
parameter s. the two graphs are 
clearly distinguished. 



adiabatic parameter s 


□ scatterplot of Q 2 against M x in 
the 5 -> 1 limit for the 41 SRG's 
with N = 29. the QAA 
distinguishes all graphs in the 
family in that limit (although 
some of the values are close 
together). 
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The graph isomorphism problem 

□ perhaps there are "better" Hamiltonians than the one chosen 
here, here, we have used "glassiness" to solve the graph 
isomorphism problem. 

□ perhaps there are better measurements that can be 
performed in order to distinguish between graphs, e.g., 
susceptibilities, here, we have mainly used the spin-glass 
order parameter. 

□ can be tested experimentally on existing D-Wave hardware 
with relatively minor modifications. 

□ it is unclear whether or not the algorithm s efficient, what is 
the nature of the quantum phase transition? need to 
investigate size-dependence of minimum gap. 

□ clearly more testing is needed. 
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^^^^Conclusions and future research 
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Conclusions 


□ for the SAT problems investigated, we don't find that QAA is better 
than state-of-the-art classical algorithms. 

□ we find that the harder a problem is for classical algorithms 
(WalkSAT), the harder it is also for the QAA. 

□ for the Max-Cut (random antiferromagnet) problem, results point to 
a polynomially decreasing gap near the quantum phase transition, 
it seems however that the overall gap behavior is exponential. 

□ QAA seems to be able to solve the graph isomorphism problem 
(more tests are needed) however the efficiency of the algorithm is 
not yet known. 
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